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Abstract 

The aim of this paper is to extend the aggregation convergence results given in [1, 2 to doubly 
stochastic linear and nonlinear processes with weakly dependent innovations. First, we introduce 
a weak dependence notion for doubly stochastic processes, based in the weak dependence defi- 
nition given by Doukhan and Louhichi, and we exhibe several models satisfying this notion, 
such as: doubly stochastic Volterra processes and doubly stochastic Bernoulli scheme with weakly 
dependent innovations. Afterwards we derive a central limit theorem for the partial aggregation 
sequence considering weakly dependent doubly stochastic processes. Finally, show a new SLLN for 
the covariance function of the partial aggregation process in the case of doubly stochastic Volterra 
processes with interactive innovations. 

Keywords: Aggregation, weak dependence, doubly stochastic processes, Volterra processes, Bernoulli 
shift, TCL, SLLN. 

1 Introduction 

The aggregation of doubly stochastic processes with interactive innovations has been little 
studied, because dependent innovations induce a dependency structure for the doubly stochastic 
processes which can be difficult to study, especially in the case of nonlinear processes. 

In the literature for aggregation of linear process, see [TH [T31 UHl UHl HH] j usually introduces in- 
teraction between individual innovations ej considering that this can be decomposed into a common 
innovation plus an independent innovation, i.e. = ut+£,l. So, under the presence of common inno- 
vation, the aggregation process keeps only the structure given by the common component, whereas 
the aggregation of independent components are washed out by aggregation, i.e. the convergence 
results obtained are the same that considering only the common innovation component. 

The immediate question is: it is possible to consider another kind of interactive innovation that 
allows to obtain different results to the cases of independent innovations and common innovation? 
We answer this question affirmatively, in [l] we have studied the aggregation of doubly stochastic 
gaussian processes and we have approached the problem in a different way. We introduce inter- 
action between elementary processes "living at i" starting from interaction between innovations 
as E[ejej] = x(i — j), where x is a given covariance function. Thus, the common innovation case 
is given by xU) — 1j for Ji ^^'^ f^i^ independent innovations case by xij) — 0, for j ^ 
and x(0) — 1- The procedure includes naturally the aforementioned case. Hence we obtain some 
interesting qualitative behavior of the aggregation process 

Some specific results already exist for aggregation of nonlinear processes. Several authors have 
investigated the aggregation of ARCH and GARCH processes, see gl [HI [TSl [221 [23 • AH these 
works have been developed considering exclusively common innovation or independent innovations. 
As far as wc know does not exist literature about the aggregation of nonlinear processes with 
interactive innovations. 

Our purpose is to extend the convergence results of the aggregation procedure, given in 1 , for 
gaussian elementary processes with interactive innovations to case of nongaussian processes with 
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weakly dependent innovations, our results include elementary doubly stochastic processes such 
as: nongaussian linear processes, nonlinear Bernoulli shifts, Volterra processes, ARCH, GARCH, 
LARCH and bilinear models. 

We consider a sequence of stationary doubly stochastic processes Z — {Z^ : i e N} on 
{n, A, P) X {Vt\ A', P') in by 

Z^^{Zl{y\u^),e\u')):t^'L]. (1) 

where Y = {y* : i e Z} a sequence of random variables defined on (51,^1, P), with distribution \i 
on W' and e = {e\ : i, i g Z} be a doubly indexed process defined on {n',A',P') satisfying the 
following assumption 
Assumption Al: 

1. £ is an array of strong white noises, i.e. for each i, e* = {e\} is an i.i.d sequence. 

2. Y is an i.i.d sequence with distribution v — /^®^. 

3. Y is independent of £ . 

Here, the sequence Y is considered as the random environment model and £ = {e* : i G Z} is 
the sequence of innovations = {ej : i G Z}. For simplicity, throughout the work Zl :— Zt(y',e'), 
and we use .^t(y*, £*) only if we want to state explicitly the dependence on y* and e' . 

For every trajectory fixed Y , we define {Y) = {X^ (Y) : t e Z} as the partial aggregation 
of the elementary processes {Z^} by 

= (2) 

where Bjsi is an appropriate normalization sequence. 

We study, for almost every fixed trajectory Y , the convergence of X^ iY) to some process X, 
called the aggregation process. 

We introduce a new notion of weak dependence, for a sequence of doubly stochastic processes. 
This notion is based in the weak dependence definition given by Doukhan and Louhichi, see [6J. 

We give several models of doubly stochastic processes satisfying the new notion of weak depen- 
dence. To do that we consider innovations defined in such a form that, for each t, {ej : i G Z} is 
a weakly dependent stationary sequence in the index i, see [3]. The notion of weak dependence for 
the innovations sequence {e*} makes explicit the asymptotic independence between (e^J , . . . , ej" ) 
and {e^} , . . . , ) when ii<...iu<iu + f<ji<...<iv and r tends to infinity. 

Considering several types of weak dependence already used in the literature, we show that the 
weak dependence property of innovations is transferred to the sequence {Z^} of doubly stochas- 
tic elementary processes. In fact we will prove that Z — {Z'} satisfies the new notion of weak 
dependence. This result will be prove for orthogonal expansion Volterra processes such as: linear 
processes, ARCH , GARCH, LARCH and bilinear models. We will also show this transference 
property for doubly stochastic uniform Lipchitz Bernoulli shift processes. For instance, Lipchitz 
functions of linear processes. 

Let us suppose that elementary process Z^ satisfies the following moment condition 

K25 E[|Zt*|2+'5] < oo, with <5 > 0. 

This conditions yields the existence of Z^ in L^(f7 x Q,'). We prove that under the weak dependence 
property, the interaction defined by E[eje(] — x{i ~ j)j is always a weak interaction in . So x 
has a finite limit in the Cesaro sense. 

In general, we assume that the covariance function T-^ (Y) of partial aggregation process X^ {Y) 
satisfies 

K4 {t, Y) converges v — a.s. to r(r), for all t e Z. 
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Thus, assuming that the doubly stochastic processes satisfy this new notion of weak dependence 
and moreover the conditions K2s and K4, we prove a Central Limit Theorem v — a.s. for the partial 
aggregation X'^{Y). This proof is done directly on the structure of elementary doubly stochastic 
processes and not as in 2 , for the aggregation of doubly stochastic linear process, which is done 
on the structure of innovations. This result includes some cases that have not been addressed in 
the literature. We can cite to illustrate the cases of nonlinear processes with weakly dependent 
innovations, such as general doubly stochastic orthogonal expansion Volterra processes and doubly 
stochastic uniform Lipchitz Bernoulli shift processes. 

Finally, we show a new SLLN for the covariance function (Y) in the case of doubly stochastic 
orthogonal expansion Volterra processes, DSV* processes, with interactive innovations. 

This paper is organized as follows. In Section[2]we present some doubly stochastic Bernoulli shift 
processes and we give the necessary and sufficient condition to obtain their existence in L^^flxfl'). 
In Section [3] we introduce the notion of weak dependence for doubly stochastic processes. In 
SectionlHwe present several examples of weakly dependent innovations and we show that considering 
different weakly dependent innovation models we can obtain weakly dependent doubly stochastic 
models. In Section [5] we give the CLT v — a.s. for general sequence of weakly dependent doubly 
stochastic processes. In Section [5] we give a SLLN for in the case of DSV* processes. Proofs 
are given in Section [7] we prove the results relating to the transfer of weak dependence property to 
Z, we develop the standard Lindcrberg method with Bernstein's block and yield the CLT v — a.s.. 
Finally, we prove the SLLN for T^{Y). 

2 Some doubly stochastic Bernoulli shift processes 

In this section, we describe doubly stochastic versions of several models used in statistics, 
econometrics and finance. We consider some stationary doubly stochastic elementary processes 
generated by a random parameter y defined on {Q,A,¥) with distribution /i on R*, and a strong 
white noise e — {et : t E Z} on {il' , A' i.e. doubly stochastic processes defined on {il,A,F) x 
{n',A',r) in of the form (P) 

We introduce the doubly stochastic Bernoulli shifts, DSBS, a very broad class of models that 
contains the major part of processes derived from a stationary sequence. We define the DSBS 
process in the following way, see [3]. 

Definition 1. Let 7i : R" x R^ — R 6e a measurable function. We define a DSBS process Z{y, e) 
with random parameter y in W and innovation e = {sk : k G 7j} by 

Zt(y,e) =H(y,{£t_fc}fe6z). (3) 

Since 7i is a function depending on an infinite number of arguments, it is generally given in 
term of a series defined in L^(il{^ri'). In order to define ([3]) in a general setting, we denote for 
any subset J C Z: 

Hj := n (y, {e,},ej) = H (y, {e.Mj)},^^) . 

For finite subsets J this expression is generally well defined and simple to handle. In order to 
define such model in L^{U^ fl') we assume that the function Ti is such that 

n\n{y,e)\']<oo. (4) 

The DSBS process Z(y, e) ~ {Zt{y, s)} is stationary, /i — a.s. Then, condition ^ implies that 
Z{y, e) is on L^{il ^il'), which implies its existence, fi — a.s., in L^(17'). 

As we will see in the following, most of the usually used stochastic processes can be represented 
as Bernoulli shifts. 

As an example we consider doubly stochastic uniform Lipschitz Bernoulli shift {DSU LBS) 
processes. We also study doubly stochastic Volterra processes, which correspond to random pa- 
rameters Volterra processes and we detail the doubly stochastic bilinear models given afterwards 
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their expression as a Volterra's expansion. Finally, we present several well known doubly stochastic 
bilinear models such as LARCH, GARCH and ARCH processes with random coefficients. 

We will discuss the necessary and sufficient conditions for the existence a.s. in L^(il{^ri') 
of these models. Those conditions will be very important for studying the convergence of the 
aggregation procedure. 

2.1 Doubly stochastic uniform Lipschitz Bernoulli shifts 

Let Ti -.W y. ^ M be a function such that if £, e' G coincide for all indexes but one, let 
say fco G ^, then there exists a}:^{y) fi — a.s. such that 

\Hiy,{ek}kez)~n{y,{e',}kez)\ < M^ko - e'J. (5) 

Thus, there exists a sequence a(y) = {afc(y) : k E Z}, such that H satisfies ji — a.s., for all e, e' G M.^, 
the following regularity condition 

\H (y, {Skjkez) ~ U (y, {4}feez)l < E \^Mek ~ 41- (6) 

feez 

We say that 7i is a uniform Lipschitz Bernoulli shift whit respect the coordinates e. 
Moreover supposing the following 

j \Hy)\V^^^{dy) < (X, (7) 

where ||a(?;)||£j^ ~ J2k Wk{y)\- Condition ([7]) implies that a(y) e ^i, ^ — a.s. 
Then, Z{y, e) = {Zt(y, e) : t g Z} given by 

Zt=n{y\{el_,}kez). 

defined as a doubly stochastic uniform Lipschitz Bernoulli shifts (DSULBS) process. 
Simple examples of this situation is Lipschitz function of linear processes. Another example of 
this situation is the following stationary doubly stochastic process 

Zt{y,e)^et co(y) + ^ Cfe(y)et_i 

where the innovation St is bounded and c(y) = {cfe(y) ■ G Z} is such that E[||c(y)||£j] < oo. In 
this case, condition ([5]) also holds with |afe(y)| — 2||eo||L|cfe(y)|- 

2.2 Doubly stochastic Volterra processes 

A doubly stochastic Volterra (DSV) process is defined through a convergent Volterra expansion 
with random coefficients 

oo 

Ztiy,£) = Yl ck:i,^...,i^iy)et-i,---et-i^, (8) 

fc=o ii....dkez'' 

where e is a sequence of innovation and c(y) — {ck:ii....,ik (y) ■ {h, ■ ■ ■ ,^k) 2'^', fc G Z} is a sequence 
of random coefficients. 

We assume that e is a strong white noise such that, for all A: G N, E[|etp'^] < oo. Let us note £^ 
the space of sequence c = {ck:ii,...,i^ ■ {h, . . . ,lk) & , k & Z} such that 

oo 

\\c\\l^Y.^[\e,n E \^k:H,-,i.\'<^- (9) 
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If c(y) satisfies condition ^ ^ — a.s., this entails the ^ — a.s. convergence in L^(ri') of the series 
([5]). Since e is a strong white noise a sufficient condition for the convergence in L^{n x 57') of the 
series (jH]) is 

C2 E[|lc(y)||2j <cx3. 

In order to obtain condition C2 it is necessary the existence of all moments of e, hence is 
sufficient the existence of Laplace transform of distribution P^. This holds, for instance, if e is a 
sub-gaussian process. 

Remark 1. We note that the DSV process correspond to a DSBS process in the case of chaotic 
expansion associated with the discrete chaos generated by the innovation e, \2b\ i22^ . We can 
consider that, for each y fixed, 7i(y, •) is expanded, in sense, into this chaos as 

oo 

H(y,e) = ^7^«(y,£), 

k=Q 

where Ti^''^{y,e) denotes the k-th order chaotic contribution, TC'^^^ = co(y) and 

n^''Hy,£)= Cfc:i,,...,z,(yK ...£;,. 

ii,...Jfcez'= 

The process Ti^*^^ (y, {£4_j}jgz) is called the DSV process of order k. 

The most simple DSV process are the linear processes with random coefficients, defined by 

Zt{y,e) = Y,^k{y)et-k. (10) 

fcez 

These linear processes are DSV processes of order one. 

An interesting particular case of Voltcrra processes is obtained when the chaotic expansion is 
given by 

oo 

Zt{y,e)^Y ^ ckdu-,ik{y)st-h---st-h- (11) 

fc=0 li<...<lk 

The corresponding fc-th order Volterra processes are pairwise orthogonal. In the following, we 
will referee this type of doubly stochastic Volterra processes with orthogonal expansion by DSV* 
processes. Since Zt(y, e) is a sum of orthogonal terms, if the innovations satisfies E[|efp] = 1, the 
series ([TT|) is /i — a.s. convergent in i^(il') if and only if 

oo 

l|c(y)ll2=E E |Cfc:ii...,i.(y)l' II- a.s. (12) 

fc=0 ii<.--<'fc 

In this case, we put — l2, the space of sequence c such that ||c||^^ — ||c||2 < oo. Then, we have 
that 2'(y, e) belongs to L^(il{^ $7') if and only if condition C2 is satisfied. 

The difference with the general case is that the indexes in the product are all different. So that, 
in the general case, we do not get the orthogonality property, which is a disadvantage, see [S]. 

Nevertheless, the i.i.d sequence £ = {et : t € Z} can be replaced by a vector-valued i.i.d sequence 

{(ef'^\...,ef'''^) : <gz}, such that {e^^^-') ■l<k) are mutually orthogonal. This is obtained 
by replacing each power of an innovation variable with its decomposition on the Appell polynomials 
of the distribution of Sq, see e.g. [S]. 

Then we can rewrite the process, under condition C2, as a sum of orthogonal terms given by 

oo 

Uy.e)^Y. E (13) 

fc=0 W<...<lk 

In the following section, we present some examples of DSV* processes. These models are a nat- 
ural extension of models that are well known in the literature and have many sorts of applications. 
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2.3 Doubly stochastic bilinear models 

A vast literature is devoted in order to study the conditionally heteroscedastic models. The 
heteroscedasticity property is characterized by the fact that the conditional variance var{Zt\It~i), 
given an information set It-i, is not a constant. 

The bilinear models allows unify the treatment of heteroscedastic models. These models are 
defined by the relation 

COO \ / OO \ 

ao{y)+Y,My)Zt-kj + lbo{y) + Y^h{y)Zt-kj Sf (14) 

where e = {et} is a sequence of i.i.d. centered random variables such that E[|etp] = 1, and 
a(y) = {afc(y)}, b{y) = {bk{y)} are real random coefficients, not necessary nonnegative. 

This models appears naturally when studying the class of processes with the property that the 
conditional mean mt{y) = W[Zt\Zk, A: < t] is a linear combination oi Zk, k < t, and the conditional 
variance CTj (y) = var{Zt\Zk, k < t) is the square of a linear combinations of Zk, for fc < t, as it is 
in the case of 

CT?(y) = ^feo(y) + ^6fc(y)Zt_fej and mt{y) = ^ao(y) + ^afe(y)Zt_fe^ . 
Let us take 

a(s,y) = E^lafc(y)s^ 9{s,y) = (l-6(s,y))-i = E^o5/c(y)s^ 

b{s,y) = j:Zibkiy)s\ his,y) = a{s,y){l~b{s,y))-' = j:Zohk{y)sK 

If we suppose that H{y) ~ ^fij) < 1 M — a.s., then there is, jj, — a.s., a unique second order 
stationary solution given by 

oo 

■^t(y,e) = feo(y)Xl XI 9h{y)hh-h{y)---hi^-ik-Ay)st-h---et-i^. (15) 

k=l 0<li<...<lk 

Then, Z{y, e) is a DSV* process with random coefficients 

co(y) = &o(y) and Ck:ii,...iu{y) = 9iAy)hi2~iAy) ■ ■ ■hi^-i^_,{y). 

We present the necessary and sufficient conditions for the existence in of process Z{y, e) 
defined by dH]), see [H]. 

Let G{y) = J2^o dfiy)- ^o(y) < oo and H{y) < 1 /i — a.s. we obtain 

My)\\l-bl{y)± 9UyK-^Ay)---hU.-M) = f^- m 

fe=l 0</i<...<ifc 



Then, from (fTH|) . we obtain that the following conditions 



H{y) < 1 fj, — a.s. and E 



bUy)G{y) 



il-H{y)) 



< oo. (17) 



are necessary and sufficient for the existence of a stationary L-^-solution to (fTi| . This solution 
Z{y,s) is given by (fTSjl . 

Formally the classes AR, ARM A, ARCH, GARCH, LARCH with random coefficients all 
belong to the class of doubly stochastic bilinear models. In the follows we details the necessary and 
sufficient condition for the existence of L^-solutions for some of those classes. 
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2.3.1 Doubly stochastic LARCH{oo) processes 

We consider the doubly stochastic LARCH{oo) models given by 



(18) 



fc=i 



with real value random coefficients, not necessary nonnegatives, and e = {st} a white noise. The 
LARCH model with deterministic coefficients has been introduced by Robinson, see [53]. For a 
vectorial version of this model, see [S]- 

Let us denote B2{y) — J^'kLi ^fc(y) ^^'^ l^IktP] = 1- Following the same way that for bilinear 
models we obtain that conditions 



^2(y) < 1 II — a. s. and E 



l-B2{y) 



< oo 



(19) 



are necessary and sufficient for the existence of a stationary L^-solution to (fT8| . 

The stationary solution of equation (jlSp has a orthogonal Volterra expansion given by equation 



Zt{y,e)^Y^ bo{y)bi,{y)bi,^i^{y)...bi^_i^_^{y)etSt-i^...et-i^. (20) 



2.3.2 Doubly stochastic ARCH{oo) processes 

Here we consider the random coefficients nonnegative ARCH model defined as follow. A process 
Z(y, e) = {Zt{y, e) : < G Z} is said to satisfy random coefficient ARCHipo) equations if there exist 
a nonnegative i.i.d. innovation sequence e — {et : i G Z} and nonnegative random variables {fcfe(y)} 
independent of e such that 

Zt = ||&o(y) + Y.bk{y)Zt^^ et a.s. (21) 

Note that the random coefficient ARCH process given by equation (PT|) is a nonergodic process. 

Classically, ARCH process we mean the model where the returns rt admit a representation of 
the form 

oo 

n^at£,u <J^t=bo + Y,bkrtk- (22) 

A,-l 

where ^ = {^t} is a sequence of i.i.d random variables with zero mean and finite variance, and tif 
is a linear combination of the squares of past returns. The GARCH{p, q) model is defined by 

P 9 

rt = Tt^t, (tI = ao + ^ Pkcr1-k + ^''^t-k- (23) 

fe=l k=l 

Under some restrictions on the polynomials a{z) = X]fe=i Q^fe^'^ ^^'^ — X)fe=i Pkz'^ , the model 

can be rewritten in the form (|22p . 

Then, denoting Zt — and £t — £,t, we represent this model in the ARCH form (PT|) . see pS] , 
In the case of nonrandom coefficients, those models are introduced by [25] and subsequently 

studied in [TUl [El HSj . For the case of random coefficients see [HI [T7] . 

Let Ai = lE[£t], A2 — IE[£(] and B{y) — J2T=i^k{y)- The recursion relation (|2T|) yields the 

following Volterra series expansion of Z{y, e): 

00 

Zt{y,s)^Yl bo{y)bi,{y)...bi^^i^_^{y)etet-i,...et-i,. (24) 

k=0 0<h<...<lk 
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In order to obtain the necessary and sufficient conditions for the existence in of process Z{y, e) 
defined by (dH), one needs to study orthogonal Volterra representation of Z(y,e). This orthogonal 
representation is obtained by replacing the et's by St = Ai(k£( + 1), where = (A2 — and 
it have zero mean and unit variance. We can rewrite (|2ip of the bilinear form, see [llj , 

Zt{y,e) = lxibo{y) + Y2Xibk{y)Zt-k] + lKXibo{y) + f2K\ibk{y)Zt-k]et. 



fe=i 



k=l 



Then, similarly to case of bilinear models, we obtain that Z{y, e) the following DSV* represen- 
tation where 



Zt{y,e) 



with go = 1, 



AibQ(y) 
1-Aii?(y) 



k=l 0<li<...<lk 



k=0 



k=l 



and hkiy) = Kgk{y), for k > I. More explicitly. 



fc=i o<ji<...<ife_i<; 
Let H{y) — J^'iZi ^?(y)- Thus, we obtain that the following conditions 



E 



AiS(y)<l, i?(y)<l ^i-a.s. 

bl{y) 

(l-AiB(y))2(l-ff(y)) 



< 00. 



(25) 
(26) 



are necessary and sufficient for the existence of a stationary L^-solution to pTj) . 
Now, we present an examples of ARCH models. 

Example 1 (Doubly stochastic GARCH{1, 1) processes). Let us consider the random parameters 
GARCH(1, 1) model given by 

rt{y) = CTt(y)6, o^tiy) = My) + a(y)f^t-i(y) + /3(y)^?-i(y), 

where Q;o(y), oi{y) and (3{y) are nonnegative random variables independent o/{^t}. We note that 
the corresponding ARCH{oo) equation ()22p is obtained taking the random parameters as 



60 (y) 



ao(y) 



and 6fe(y) = a(y)/3'=-i(y) 



1 - Piy) 

Let g{y) — AiQ;(y) +/3(y). Ln this case hk{y) — XiKa{y)g{y)'^^^ , then 



a(y) 



1 - m 



and H{y) 



>\n^o^\y) 



So, Z{y, e) exist in L^ if and only if 



E 



g^{y) + XlK^a^iy) <1 ^ - a.s. 

«g(y) 



(l_g)2(l_g2(y)_^2^2^(y) 



< 00. 



(27) 
(28) 
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Example 2 (Doubly stochastic ARCH{1) processes). We consider the random parameters ARCH[1) 
model given by 

rt{y) = Kt{y)^t, K?(y) = Q;o(y) + a(y)Kj_i(y), 

where cto(y) o-nd a{y) are nonnegative random variables independent of {^t}- We note that the 
corresponding ARCH(l) process is a particular case of the GARCH(l,l) process, when we take 
the parameter /3(y) = 0. Thus, boij) = ao{y), &i(y) — ct{y) cind bk{y) — for k > I. In this case 
hk{y) — i^{^iOi-{y))^^^ ■ Then Z{y,e) exists in if and only if 



E 



A2a(y) < 1 - a.s. (29) 



«§(y) 



(1-Aia(y))2(l-A2a2(y)) 



< oo. (30) 



3 Weak dependence for doubly stochastic processes 

In this section we introduce a notion of weak dependence for sequence of doubly stochastic 
processes following the definition of weak dependence given by Doukhan and Louhichi, see [5]. 

Let A'*^) be the set of bounded Lipschitz functions / defined on R*^ such that for all {zi, . . . , Zk) 
and {zi, . . . , Zf^) in R'^ 



fc 



|/(zi, ...,Zk)~ f{z[, . . . ,Zfc)| < Lip{f) ^ 



Above we denote the Lipschitz constant of / by Lip{f). Let A^^'^-' be the set of function / in A'^'^^ 
such that ll/lloo < 1. 

Let {Zi\ be a real-valued stationary process. 

Definition 2 (Doukhan and Louhichi). The process {Zi : i Cz is {e,il)) -weakly dependent if there 
exist a sequence e(r) decreasing to zero at infinity and a function ip from x (R+)^ to R+ such 
that 

\cov{f{Zi^,...,Z,J, g{Zj^,...,ZjJ)\ < ip{u,v, Lip{f), Lip{g))e{r), 
for any r > and any {u + v)-tuples such that ii < ... < i„ < in + r < Ji < ... < jv, where 

(/,g)eA(")xA("\ 

We introduce next e the dependence coefficient. 

Remark 2. The e- coefficients depend on the form of function -tp. Let J{u, v, r) the set of (u + v)- 
tuples such that ii < ... < iu < «ti + r < ji < ... < jv Given a function ip from x (R+)^ to 
, the e-coefficient associated to ip is defined by 



e{r) = sup sup sup 



\cov{f{Z,„...,Z^J, g{Zj„...,ZjJ)\ 



y.,v j(u,v,r) (/,g)eA<"' X A<") ■^*?'(/)' Lipid)) 

Specific functions tp yield notion of weak dependence appropriated to describe different models. 
In the following, we will consider different types of ip which are used in the current bibliography of 
weak dependence, see [3 EJ E] . 

• A-weak dependence: the A-coefficient corresponds to ip{u,v, a,b) — au + bv + abuv, in this 
case we simply denote e(r) = A(r). 

• ?7-weak dependence: the T^-coefficient corresponds to 'ipiu, v, a, b) ^ au + bv, we denote e(r) — 
■q{r). 

• 0-weak dependence: ^-coefficient corresponds to ipiu, v, a, b) — bv, in this case we write e(r) = 
9{r). This is the causal counterpart of ry-coefficients. 
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• K-weak dependence: in this case the K-coefRcient corresponds to ip{u,v, a,b) = abuv, and we 
write e(r) = K{r). 

• re'-weak dependence: the K'-coefhcient correspond to ipi^, v, a, b) = abv, in this case we denote 
e(r) = K'{r). This is the causal counterpart of K-coefHcient. 

We now extend the notion of weak dependence to a sequence of doubly stochastic processes. 
We consider Z = {Z'^ i S Z} a stationary sequence of stochastic processes, = {Zl : t G Z}. 

Definition 3. We say that Z = {Z^ : z G Z} is {e,ip,Y) -weakly dependent if, conditionally to Y 
and for almost all trajectory Y, there exist a sequence e(r) decreasing to zero at infinity, a function 
ip from X (M+)^ to and a positive random variable V{y) such that, 

cov [fiZll,..., Zl:), 5(^v Zin) I < mAY) , dyAY), Lipif), Up{g)) e(r), 

for all (ti, . . . ,tu) G Z" and (t'l, . . . ,t'^) G Z^, for any r > and for any {u + v) -tuples such that 
ii < ■ ■ ■ < iu < iu + r < ji < . . . < jv, where {f,g) G A^"'' x A^^^ i« = ■ • ■ , i«) Jv (ji, • ■ ■,jv) 
and 

U V 

rn— 1 m— 1 

and W'[\Zl\'^] < V^{y') < oo, fj..a.s. 

Remark 3. When measure fj, is degenerate, i.e when y' — y for all i, then if the stationary process 
Z = {Zt{e^) : i,i G Z} satisfies Definition\^we simply say that Z is e-weakly dependent. 

We introduce the following condition: 

K5. E[V^(y)] < oo. 

This condition implies that V{y) < oo, fx.a.s. 

Remark 4. In definitions^ the random variable V'^{y) establish a control of the y -conditional 
variance of Zt{y,£). We will see that in some case W[\Zt{ye)\'^] = V'^{y), for instance for DSV* 
processes. 



4 Transference of the weak dependence property to doubly 
stochastic models 

We show that for different weakly dependent innovation models we can obtain weakly dependent 
doubly stochastic models. 

Let us consider doubly stochastic Bernoulli shift processes defined, as in Section [21 by 

Zt{r,e)^n{y\{eU}keE). (31) 

where TC : W x M.^ M be a measurable function in L^(ri{^ri') and we suppose that, for each 
t, {el : i G Z} is weakly dependent. We show that such property of weak dependence for the 
innovations is transferred to the doubly stochastic processes. We present some examples, already 
known in the literature, of weakly dependent innovations. 



4.1 Examples of weakly dependent innovations 

In the following, we give examples of weakly dependent innovations, for more details to respect 
of theses innovation models see [21 E] . 

Remark 5. In this work, we denote by Ti.^ to Bernoulli shift innovation and simply by Ti. to doubly 
stochastic Bernoulli shift. 
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4.1.1 Bernoulli shift innovations 

Let us take — He a Bernoulli shift with input {^'}. We assume that, for all t 

fixed, the shift He satisfies the following condition 



oo 



Wn < OO. (32) 

n=l 

where 



w„ = E 



I'He {{Ct '}|/|<n) - 'He {{Ct '}|;|<«) | 



This condition indeed proves that the sequence {He {{Q}\i\<n)} has the Cauchy property in the 
space L^(ri') and so its convergent. Let Sr — X]n>r^" then {5j.}rgN converges to zero as r ^ oo. 

Doukhan et al. prove the following results, for each t fixed, see Lemma 3.1, Lemma 3.2 and 
Lemma 3.3 in [3 . 

Theorem 1 (Doukhan et al.). 

• Noncausal shift innovations with independent inputs 

//{^J} a sequence of i.i.d. random variables then the innovations {el : i £ Z} are rj-weakly 
dependent with ri{r) < 2d^r/2\ ■ 

• Noncausal shift innovations with dependent inputs 

V {Ct ■ I E 1^} is rj^-weakly dependence then the innovations {e\ : i E Z} are r]-'weakly 
dependents. 

If {S}t] is X^-weakly dependent then {ej ; i € Z} are X-weakly dependents. Nevertheless, if the 
input sequences are K-weakly dependents then the innovations {ej : i S Z} are neither k nor 
rj-weakly dependents. 

• Causal shift innovations with independent inputs 

Let us take el = He ({Ct '}iGN) a causal Bernoulli shift with input {^1} a sequence of i.i.d. 
random variables. Then, the innovations {el : i € Z} are 0-weakly dependent with 0{r) < 26r 
and Sr = I]«>r^n- 

Example 3 (Linear innovations). If el — X^iez /^'Ct~'' ll/^lli — TliiPi < °° {Ct} o, sequence of 
i.i.d. random variables, then el is rj-weakly dependent with rj{r) < (^J2\i\>r f^i 

Example 4 (Volterra innovations). // we suppose that el is defined by the following Volterra 
expansion 

oo 

k=0 h<,...,<lk 

where {f3k-ii,...,i^. ■ {h, . . . ,lk) € Z'^} is a sequence of real numbers and {^|} is a sequence of i.i.d. 
random variables. This expression converges in L'^{n') provided that E [\£,i\'^] < 00 ana 

oo 

11/3112 = E E \Pk;H,-U\'<^- 
k=0 li<,...,<lk 

In this case, we can verify that el is rj-weakly dependent. 

2r-l 



fe=l -r<ii<,- -,<'fc<»' 

Condition ||/3||2 < oo implies that r]{r) converges to zero as r ^ oo. 
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In the general case of Volterra innovation 

oo 

k—O li,...,lk 

we have that this expansion converge in L^{Q'), whenever 

oo 

^E[|Cjn I/3mi,...,^J' < oo- (33) 

fc=0 ll;...,lk 

Then, 

2n+l 

k—l —71— 1 1 < , . ...<lf:—n 

oo 

v{r)' < Emm E \Pk-M,...,ij' 

k^O li<...<lk<-r 
oo 

+ Emm E \Pk-M,...,ij'- 

fe=0 /i<...<ifc<-r 

So, under condition p3p . we can also obtain that r](r) converges to zero as r — > oo. 
This case include noncausal LARCH , ARCH , CARCH and bilinear models. 

Example 5 (Causal LARCH{oo) innovations). 

general causal LARCH{oo) models are 9-weakly dependents. For instance, linear innovations, 
ARCH, GARCH and bilinear models, see 

4.1.2 Associated innovations 

A process {e'} is associated if 

cov >0, 

for any coordinate wise non-decreasing function /, g : M" M. Associated processes or Gaussian 
stationary processes are K-weakly dependents with 

K(r) = sup I cow (e*, e*^-') | . 

j>r 

For instance, independent sequence are associated and gaussian processes with non-negative co- 
variance are also associated. This models are classically built from i.i.d sequence, see [3T]. 

4.2 Uniform Lipschitz Bernoulli Shifts with weakly dependent innova- 
tions 

Here, we consider the DSULBS processes — {Zl : t E Z} given by 

Zl=n{y\{sU},^^). 

where H :M.'^ x ^ M be a measurable function satisfying conditions (O and ([7]). 

A simple example of this situation is the doubly stochastic linear process. Another examples 
are obtained considering Lipschitz function of linear processes. 

In the following, we will consider that, for each t, {el : z g Z} is e-weakly dependent. Then, we 
prove that the sequence Z of DSULBS processes is in general a (e,F)-weakly dependent doubly 
stochastic processes. This is a new result and is obtained when the e-coefhcient is taking in the 
cases of A, rj, 9, k or K'-weak dependence. 
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Theorem 2. Under conditions ^ and the DSULBS processes Z with e-weakly dependent 
innovation is {e,Y) -weakly dependent, with V{y^) — ||a(y')||i. 

We will give the proof in Section [71 

Remark 6. // condition 

E2s E[\el\'^+^] < oo for some 6 > 0, 

and condition ^ holds then condition K2s is satisfied for the DSULBS process. 

Remark 7. Condition K5 is satisfied by this model, since V{y) = ||a(y)||i and so K5 is implied by 
condition ([7])- 

4.3 Doubly stochastic Volterra processes with weakly dependent inno- 
vations 

We will consider DVS* processes defined by equation PT|) : i.e. we consider the Bernoulli shift 

oo 

k=Oji<...<jk 

Then, for all e, e' G K^, we have that 

oo k 

H(y,e) -H(y,e') = H Ck:j,,...,j,e'j^ ■ ■ ■ e'^^_^{ei - e[)ej^^, . . . ej,. (34) 

iez k=iu=i ]i<---<jk 

3u=l 



We suppose that the DVS* processes Zl — H{y, {el_f.}kez) are such that the sequence c(y) = 
{cfc:ji,...jfc(y) : fc e Z, (ji, . . . ,jk) G Z*^} satisfies condition C2, i.e. 
C2 E[||c(y)||i] <oo. 

Let us take = He ({ft~'};ez) a Bernoulli shift with independent inputs {^l}. We assume, 
in the same way of Section 14.11 that the Bernoulli shift Tie satisfies condition . Then, 5r = 
Sn>r converges to zero as r — > oo. 

In this section we assume the following condition 



E 



/ ^ 2 



< 



1. (35) 



An adaptation of the proof of Lemma 3.1 and Lemma 3.2 given in [3], allows us to extend easily 
these results for doubly stochastic Volterra processes with Bernoulli shift innovations. 



Theorem 3. Under conditions p2p . ([35]) and condition C2, the sequence Z of DSV* processes 
with noncausal Bernoulli shift innovations is {r/,Y)-weakly dependent, with rj{r) < 26^^/21? 

vir) = ||c(/)||2. 

Theorem 4. Under conditions (j32l) . (I35p and condition C2, the sequence Z of DSV* processes with 
causal Bernoulli shift innovations is {6, Y)-weakly dependent, with d{r) < 25^ and V^(y') = ||c(y*)||2. 

The proofs are deferred to Section [71 

From Theorem [H we have that the noncausal Bernoulli shift innovation with independent inputs 
is ry- weakly dependent and the causal Bernoulli shift innovation with independent inputs is 0- weakly 
dependent. Thus, from Theorem [31 and Theorem [H we can confirmed that the weak dependence 
property of innovations is transferred to the doubly stochastic process. 
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Remark 8. Note that condition (I32p and (|35p are satisfied in the case of linear innovations or 
Volterra innovations, see Example and Example So, considering DSV* processes such 
that the innovations {s^} are Volterra models with independent inputs, we have that Z is a se- 
quence of weakly dependent doubly stochastic processes. For instance, this is the case of G ARCH , 
ARCH{oo), LARC H{oo) and bilinear doubly stochastic processes. 

Remark 9. Condition K5 is satisfied by this type of doubly stochastic Volterra models, in this case 
V{y) — ||c(y)||2. So K5 is implied by condition C2. 

5 Aggregation convergence results 

We consider that Z = {Z'^} is a weakly dependent stationary sequence of doubly stochastic 
centered processes. Here, we consider that conditions K2s, K4 and K5 hold. 

We now present our main results: the CLT, i' — a.s., for the sequence {X^{Y)} in the case of 
(A, F)-weak dependence and (k, F)-weak dependence. 

Theorem 5 (CLT: (A, y)-weak dependence). We assume that Z = {Z^} is (A, Y)-weakly dependent 
satisfying conditions K2s, K4, K5 and such that A(r) — 0(r^^), as r oo, for A > 2 + |. Then, 
{Y) converges in distribution, v ~ a.s., to a Caussian process X with covariance function T. 

Theorem 6 (CLT: {k, y)-weak dependence). We assume that Z = {^*} is (k, Y)-weakly dependent 
satisfying conditions K2s, K4, K5 and such that K{r) = 0(r~'^), as r —> oo, for k > 2 + |. Then, 
X'^{Y) converges in distribution, v — a.s., to a gaussian process X with covariance function T. 

Remark 10. 

• The result for {X,Y)-weak dependence implies those for {ri,Y) or {9,Y)-weak dependence. In 
both cases, we do not achieve the better results, in the sense that the hound for the dependence 
parameters is also 2 + |. 

• The results for (n' ,Y)-weak dependence is implied by case of {K,Y)-weak dependence. In this 
case the bound for these dependence parameters is 2 + | . 

The proofs of these CLT are extensions for the case doubly stochastic processes of the proof 
of the CLT for weakly dependent sequences given in (Section 7.1, [3]). The proofs are deferred to 
Section [71 

On the other hand, we prove the following lemma, which implies that under weak dependence 
property and condition £2^, given in Remark [SI x is a weak interaction in ii. 

Lemma 1. Under condition E2s: 

//{e*} is X-weakly dependent then \x{r)\ di 0(A(r)T+^). 
//{e*} is K-weakly dependent then |x('')| ^ '^('^(^))- 

The proof of Lemma [T] will be given in Section [7] This result is essentially of technical character 
and it allows us to get the SLLN for the covariance function {Y). 

Remark 11. In the case of X-weak dependence, the Lemma[l\ implies that xif) — 0{r^">^). Since, 
we suppose that A > 2 + | then > 1 , so x G • 

In the cases of rj, 9-weak dependence we obtain a similar result that for the case of X weak 
dependence. Nevertheless, in the case of k! -weak dependence the result is similar to case K-weak 
dependence. 

Remark 12. In the case of elementary linear processes Z^ with interactive linear innovation e* 
given by el — X^igz /^'^t~'' where ||/3||2 < oo and {^1} a sequence of i.i.d. random variables we have 
the following results. 
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From Theorem{^and Remark\^we have that Z — {Z''} is {rj, Y)-weakly dependent. Furthermore, 
from Remark\^ condition Kb holds. 

On the other hand, from Remark \lSi we have that if condition K2s hold and rjir) — 0{r~'^) for 
> 2 + I then x & ^i- So, from the SLLN given in fJ^ condition K4 holds. 

Therefore, if condition K2s holds and rj{r) — 0{r^^) for 77 > 2 + | then Theorem[5l implies the 
nu — a.s. weak convergence of X^{Y) to a Gaussian process X with covariance function T. 



6 An SLLN for r^(y) in the case of DSV" processes 

Now we give a SLLN for the covariance function T'^ (Y) of X'^{Y), in the case of DSV* 
elementary processes defined by equation (|lip . We consider the case of interactive innovations, i.e. 
E[eje(] = x{i ^ ])■ In this case, the quadratic form {Y) is defined by 

1 ^ 1 

DAT ' r>M ' 

i = l l<i^j<N 

where 

00 

*r(/,y^) = ^vir,,fc(/,y^)x'(»-j), 

k=l 

with 

^rAy\y') = ^'^[z'/'^zi:^?] = E c,.„....,,(/)cfc,,+.,...,,+.(y^). 

h<...<lk 

Let 7fc(r) = E[*,,fe(y% y*)] and </)fc(r) = E[«',,fc(y% y^)]. Condition C2 imphes that 
7('r) ='Ylk{T) < 00 and (^(r) = ^ 'f>k{T) < 00. 

k=l k=l 

We denote 

[x^]n,i= J2 and [\x\]n,i = ^ 

i<iT^j<N l<i^j<N 

where the function x denotes the interaction between the innovations. If Sj.fc = x'^ij) then 

Given that, for all fc > 1, x'' is positive definite, we have that Nx''{0) + [x'']n.i > 0. Hence 

■w{x'']n,i = jf Lili Si,k > -1- 

If X e ^1 then, for all fc > 1, x*" G ^1 and 

1=1 i=l ^ ^ 1=1 

So, {si,fc : i G N} converges in the Cesaro sense to \sk with — 1 < s^: < c». 

Theorem 7 (SLLN for {r): Volterra processes case). If x ^ ^\ o"*^ condition C2 holds, then 
taking — ^/N we have that T-'^ (Y) converge v — a.s. and in L^{i') to F given by 

00 00 

k=l k=l 

The proof of this theorem is an extension of SLLN given in [T] for the case of linear processes. 
The details are given in Section [71 
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7 Proof of the main results 

7. 1 Proof of Theorem H 

Without loss of generality we give the proof in the case of A- weakly dependent innovations, since 
in the other case the proof is similar. 

Proof. Let ii <, ■ ■ ■ ,<iu < + f < Ji <,■■■,< jv any {u + t;)-tuples and r > 0. 

Let us consider Zl — Ti ^y% with {t{k) : k ^ Z} any sequence of indexes in Z and let 

us take 

For sake of simplicity, for aU / e A^"^ and g e A^"', we denote F = / {Z\\, . .-.Zll), G = 
and 

It is easy to verify that 

Liv < dl^ {Y)Lip{f ), Lip (g(^)) < dl {Y)Lip{g), (37) 

where 

U V 

dt\^) = E E hiy"")\ -EE • 

m=l |fe|<s m=l |fe|<s 

The proof proceeds in three parts: 




Part a: First, we want to prove by means of an inductive procedure the following result: considering 
F'-^^ and G*^*' functions of types (f5S| such that equations (fS7| holds, then 

co«(F(^), G(^)|r)| < ^ [d[l\Y),d['J{Y),Lipif),Up{g)) A(r), 

where V'C^iu j i ^) = a'^i„ + bdj^ + abdi^dj^^ . 
The proof of this part contains three steps. 



Step 1: We verify the inductive hypothesis for s = 0. 

Let us = cr{0} and 6^ = fi ({^(o) , ^(((o) : 1 < ^ < m^) for 1 < to < u A w . If we fix 
^t'i(o) ~ ^0 ' ^t'(o) ^ ^0 1 ' then we can write F^^^ and 0*^°^ respectively as 



'■^0 '^t,„+i(o)' ■ ■ ■ '"^t^co) 



r .— f V^t„+i(0)' ■ ■ ■ ' ^t„(0)y ^ ^ ytiQ,...,Vn ,fc. ,„^,...,fc 

/^(O.m) riO.rn) f J^+i Jv \ _ r" (0) f J™ g.J>"+i 



Now, we introduce the following notation 

F(o>i) = ^(0,1) (^eji^^^j := [F^ [fii] , 
G(o,i) = (5(0,1)^^^1^^^^ _ E^[G(o)|Si], 



C+i(o)' ■ ■ ■ '^tUo) 
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and for m > 1 



p(0,m) 
Q(0,m) 



p(0,m-l) 
Q(0,m-1) 



"0 



6S 



By using the expression for the conditional covariance given B™, for Y fixed, we have that 

\cov (F(o), G(o)|y)| 

< E^ [|coi;(F(0), G(o)|y, + |cot' (E^ [F(")|61] , E^ [G^ | fii] | F) | 



E^ 



p(oa) Q(o,i) 



(F("^i), G(o-i)|r) 



< E^ 



cov 



■p(0,m) Q(0,m) 



J:T=i^^ [|coz;(f(o.'), G(0-')|r, 6^,-1) |] 



Following this procedure inductively until m = u A v, we have 



r < 



E 



|^p(0,m)^ Q(0,m) gr, 



jm — 1 



(38) 



Since, for all t, {ej : i G Z} is A-weakly dependent then 



jp(0,m) 0^(0, m) 



Y K™ 



< 



(l, 1, Lip (^f(o,"0^ ^ T^jp (g(°'™))) A(r). 



Furthermore, for Y fixed, we can verify 



Lip{F(°'"'^) <Lip{f)\ao (/'") 
Lip(G(0''")) <Ltp{g)\ao (y^") 

Thus, from equations ((5^ and (00]), we prove that 



I1G(0'™)|U < llfflloo < 1. 



Y 



U/\V 

< 5] V' (l, 1, LipiF^^^^-^), Lzp(G("'™))) A(r) 

m— 1 

^ V' A(r). 



(39) 



(40) 



Step 2: We suppose the inductive hypothesis satisfied for < s < n, i.e. if F^^^ and G*^"^ are 
functions defined in satisfying equations ((57|) then 

w (f(^), G(^)|r)| < ^ (d|:^(r), d^f (F), Lipig)) A(r). 



n, m = 1 . . . t; 



If we fix, for 



Step 3: Now we will prove the inductive hypothesis for s = n. 

Let Bn = o- (|£t"(fe), : \k\ = n, m = 1 . . . u| U {^(^(fe), : |fc| 
|fc| = n, £('"(fc) = e^"' with m = 1 . . .u and = with m = 1 . . . u then we can write F^"^ 

and G*^"^ respectively as 



})• 



ti I 



G 



where Z^'^^"^ = H (yS{. 



'{4lik)}\k\<n-i 



= 9\K 



7il:(n-l) 



, 0, eLs, 



,0,...} 
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Let us denote 

F„ = i^n(K(fe)}|fc|=n,...,{<:(,)}|fe|=n) := E[F(")|S„], 
G„ = G„({4(,)}|fe|=„,...,{4^(,)}|fe|=„) := ]E[G(")|B„]. 
By using the expression for the conditional covariance given B„, for Y fixed, we have 

\cov (f("), g(")| y)| 

< [\cov{f''"\ G(")|y,S„)|] +cov{E^ [f(")|^„] , [G(")|S„]|y) 



(41) 



= E^ 



+ \cOv{Fn, Gn\Y)\. 



cov (f("-i), G("-i) Y,B„^ 
It is easy to verify that 

iip(F("-i)) < iiK/)E™=iE|fe|<n-il«fe(y'"')l = Lip{f)d^-\Y) 
Lip(G("-i)) < i*p(5)E:=iE|fc|<„-il«fe(y^'")l = izp(5)dr'(^)- 

Thus, applying the inductive hypothesis wc obtain 

E^ [\cov (f("-i), G("-i)| y,B„)|] < V (^^Ir'^C^)' ^"'^(^)' Lip{g)) A(r). (42) 

On the other hand, let us = a (^^^l"^ (^n) ' 'Ti = 1 . . . u| U le^rj^n) '■ m = I . . . v"^^ . Now, if 
we fix e* 
respectively as 



J j-^j — e^™ for TO = 1 . . . M and = e^" for to = 1 we can write F„ and G„ 



r(0) 



.(0) 



^(0) / «i 



Using the notation 



'ti(rt)' 



...,£. 



t„(n) 



We have 



:E[F„|S+] , 

|co^;(F„, G„)|y)| 
< E^ [|cot; (F„, G„| Y, B+)\] + \cov (E^ [F„| B+] , E^ [G„| F) 



(43) 



E^ 



(fI^ 



i(0) 



Y 



Let us = cr{0} and = cr ({^^'^(fc) , ^^/(fc) : 1 < ^ < m|) , for 1 < to < u A v and = n. If 
we fix £wj.\ = e^', = e^' for 1 < Z < m, then we can write Fj°^ and G^°^ respectively as 



£.(0,m) 



p(0,m) f ■Irn. + l 

\,^t™+i (*;)'•■• '^t„(fe) 



(0) / n 



+ 1 



tAk) 
3 
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Let us denote 



and for m > 1 



G 



-JO,ni) 



(0,1) 



77.(04) ( ^l \ 

[^t[(k)) 

(0,m) 



{'^lZ(k)) 

In the same way to Step 1, for Y fixed, is obtain 



:= 

= E^ 



£.(0,m-l) 



?^(0,m-l) 



G 



BV 



BV 



Lip 



F, 



(0^ 



<Lip{f)\ak (Z-")! 



Up (Gi"'"') < Lzp{g) \ak (y^ 



IG 



(0,: 



<ll/l|oo<l, 
< biloo < 1, 



and 



Y,Bi 



)\ < i' {ct-^\Yl Up{f), Lip{g)) \{r) 

< ^ d^S^(Y)' Lipif), Up{g)) A(r), 



where d^^f\Y) = Yl=, and (Y) = Y.l=i Wiy'^) 



(0,fc) , 



Getting from equations (143p and (jSI, 



' ^Ir^ - ^*^'(/)' ^^^'(5)) M^)- 



Finally, from (gT]), (O and (gni), we have that 



cow 



1^ jr(" 



< 



A(r). 



Part b: Taking n ^ oo yields 

\cov{¥, G\Y)\ < dj„(y), i*p(5))A(r), 

where 

diAY) = E ll«(y''")|l ' and rfj„(y) = ^ ||afe(y^'")|| 



m— 1 



m— 1 



(44) 



(45) 



Part c: For f,g £ A^"^ x A^"^ and Zj = H (y^ {e\_f}kei) we denote 

f = / {Zll , . . . , Z,':) , and g = 5 (z,^/ , . . . , Z,^,"^ 
Then, reindexing the sequences {ej_j,}feez by {ej(j,)}fcez it holds 

|coi;(f, g|y)| < ^«(y), dj„(y), Lip[g))\{r). 
-11-11 

Furthermore, we can verify that E^ [l^tP] ^ < n^y*) ~ ^(y*)- Therefore, Z is a (A, y)-weakly 
dependent doubly stochastic process. Analogously, the result can be proved for the cases of r/, 9, k 
or K'-weak dependence. □ 
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7.2 Proof of Theorem H 

This proof is an adaptation for the case doubly stochastic of the proof of Lemma 3.1 given in 



Proof. Let C'^^'^ = Ck^'^iKs, 4'^'' = 



Let / e A^"-* and g G A^"'' with u, u G N, and ii <,...,< iu + r < ji <,■■■,< jv with r > 2s. 
We denote 



f = f{zii,...,zi:), f(^) = /(z, 



«1:(S) 



g = g{Zp^,...,Zin, 

The sequences jci'^'*'' | and {^^'/'*''}i>i+r are independent if r > 2s. Then, we have that f'^'') 
and g^*^ are independent and thus 



|coz;(f, g|y)| < 
< 



2\\g\\^E^ [if-f^'^)]] +2||/||ooIE^ [l 

U 

< 2izp(/)^E^[|z,'::-z;:'(^)|] 

771 — 1 

+ 2L^p{g)j2E^[\Zir^zir^% 



g g 



We can verify that, for almost all y*, \\Zl 



his): 



|c(y')|| and conditions 



Ey [\zi- z\ 

< Ey'[|z*-z;'^'^|2]5 

oo A: 

< IEEE E 

iezfc=i«=iji<...<jfc 



\ 



J 



5]) imply 



(46) 



< \\cir)\\^E[\H,{{Cr%ez)~HMr%\<s)\ 

< \Hr)\\2^s. 

From condition C2 we have that ||c(y)||2 < oo /i — a.s. Therefore, for 7/(r) < 2(5^,.y2j and 
V(y) = ||c(y)||2 the result follows. □ 

7.3 Proof of Theorem [4] 

This proof is an adaptation for the case doubly stochastic of the proof of Lemma 3.2 given in 

Proof. Let ^f''^^^ = e^%i<r}, 4'^''^ = ({^r'''^^ J and Zf'^^^^ = H (y^ {e^.^} 
Let / S A J"'' and g € A^^' with u,v €N, and ii <,...,< iu < iu + r < ji <,...,< jv with r > 0. 



feez 



We denote 



f = f{zii,...,z;:), 

g = 5(Z,^,\...,Z,^,"), 
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The sequences {Ck}i<i l^k''^^ f independent if r > 0. Then, f and g^""^ are inde- 

L J l>i+r 

pendent and so 

|coi;(f, g|r)| = |coi;(f, g-gW|r)| 

< 2||/|ULzp(g)^E^[|Z^r-Z^r'('-)|]. 

m— 1 

On the other hand, conditions jSH) imply E^' [\Z{ - Z{''^''^\] < ||c(yJ||2(5.r. Furthermore, from 

1 

condition C2, we can verify that [\Zl\'^] ^ = ||c(y')||2 

< oo fi — a.s. Therefore, we obtain the 

result for 9{r) < 2Sr and V(y) = ||c(y)|l2. 

□ 

7.4 Proof of Central Limit Theorems [5] and [6] 

In this section we proof the Central Limit Theorems [5] and [6] for the aggregation of weakly 
dependent doubly stochastic processes under condition K2s, K4 and K5. The CLT arc obtained by 
using Berstein's blocks arguments. This proof is similar to proof of CLT given in (Section 7.1, [3]) 
but it is adapted in the context of sequence weakly dependent of doubly stochastic processes. 

Let f{z) = exp~'^^, / S C'^(R) with bounded derivatives up to order 3. In the following, for 
X, t fixed, we prove that 

|A^| = \E^[f{X^{Y)) - f{X,)]\ > 0, 

N^OQ 

where {Y) is the partial aggregation process and X is a gaussian process with covariance function 

r(r). 

Let us consider three sequences of positives integers p — {p(A^)}7vgN, q — {q(A^)}7vgN and 
r — {r(A^)}jvgN such that: 

• limAT^co = liniAT^oo = 0. 

• 'r{N)= p(^M)+q(N) ' liniAT^oo r{N) = oo. 

These sequences are chosen to form the Berstein's blocks /i, /,. and Ji, defined by: 

/„ = {{m~l){p{N) + q{N)) + l,...,{m-l){p{N) + q{N))+p{N)}. 
J„ = {{m-l){p{N) + q{N))+p{N) + l,...,m{p{N) + q{N))}. 
Jr = {r[p[N) + q{N)) + l,...,N). 

Let / — lJL=i ^rn: J = UL=i ^^"^ ^"i — J2ieim ^t' ^'^^ ' zcro-mcan Gaussian 

r.v. independent of the innovations {e*} and such that E[|A/'mp] = E^[|[/,„p]. We also consider a 
sequence U^, . . . ,U* oi mutually independent r.v. such that, given Y, U*^ has the same distribution 
as Um- We take = VN, then Ajv is decomposed as 

4 

Aiv(r)-^A,,^(y), (47) 
1=1 
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where 



Al,Ar(r) 

A2,Ar(r) 



= E' 



= E' 



A^^n{Y) = E^ 



-/ 

-/(r(o)AA) 



We now define a truncation procedure in order to be able to use the previous weak dependence 
condition and applying the Lindenberg method. 

For T > 1, define friz) = (z V -T) A T, z e M. Then lip{fT) = 1 and ||/t||oo = T. 

Lemma 2. E[\Zi - fxiZl)]''] < 2E[\Zl\"']T-^"'-''\ forkeN and m > 0. 
Proof. Applying the Holder's and Markov's inequalities yield 

E[\zi - Mzit] < mz\'+T''nz\>T] 

< 2E[|Z|'=1|z|>t] 

< 2E[\zr]^p{\z\>Ty-^ 

'E[\Z\" 



< 2E[|Zr]' 



< 2E[\Zr]T^^"'-''\ 



□ 



Lemma 3. 

If Z is (\,Y) -weakly dependent then 

\cov{ZlZl)\<m\Zl\^+'] 



2(E[y(y)]+E[y(y)]2))A(z-j)T+7. 



If Z is {k^Y)- weakly dependent then 

\cov{ZlZl)\ < m\Zl\^+']+E\V{y)r))n{^- j). 

Proof. 



\cov{Zl,Z[)\ < 



\cov{Zl-fT{Zl), Zl)\ 
\cov{fT{Zi), Zi - fT{Zl))\ 
\cOv{fT{Zt), fT(ZD)\. 



{^^) 
[Hi) 



then -rr + r = 1- The term (i) is bounded applying Lemma [2] and 
cov{Zl~fT{Zl),Zl)\ < E[\{Zl-fT{Zl))Zl\] 



Let m — 2 + 5 and q — , 

^ m — 1 " m q 

Holder's inequality 



] iml 



< E[\Zl-fT{Zl)\r^E[\Z, 

< (2E[|Zt'r]r™-«)iE^[|z/r]^ 

< 2E[|ZtY"]r-("-2)^ 
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For the term (ii) , from Lemma [5] we have that 

\cov{MZl), Z{ - < 2TE[\Zl - MZl)\] 

< 4E[|z||"]r-(""2). 

We now consider a trajectory Y fixed, then if Z is (A, F)-weakly dependent 

IcoviMZl), MZ{)\Y)\ < [TVif) + TV{y=) + V{f)V{f)) A(z - j). 

Taking expectation with respect to Y and applying Holder's and Jensen's inequalities we can bound 
the (iii) term by 

\cov{fT{Zl), fT{Z{))\ < E[\cov{MZl), fT{Zl)\Y)\] 

< {2TE[V{y)]+E[V{y)]')X{i-j) 

< 2T{E[V{y)]+E[V{y)]')X{i-j). 

Finally, taking T = A(i - j)^^^ 

\coviZl, Zl)\ < (6E[|Z,^r]T-(™-2) + 2T(E[F(y)] + E[Viy)]^))X{i - j) 



< m[\Zt 



|2+5i 



2(E[y(y)]+E[y(y)]2))A(i-j)^. 



In the case of (K,y)-weakly dependent, we have 

IcoviMZl), fT{Z^,)\Y)\ < V{r)V{f)K{t~j). 
Then, if we take T — K{i — j)^ , in a similar way to the case of (A, F)-weakly dependent it yields 
\cov{Zl, Z{)\ < 6E[\Zir]T-^"^-'^ + E[y(y)]2«(z - j) 



< 



{6E[\Zl\'+']+E[V{y)r)^{^^3). 



□ 



Lemma 4. |Ai,w(F)| = O (^(^V^) ly - a.s. 

Proof. Using Taylor's expansion up to the first order, we obtain 



|Ai,A.(ni < \\f'\\oo-^E^ 



ll/'ll 



E ^tZi 



N — pr 
N 



E^'o(y 



On the other hand, since Y is stationary then condition K4 implies 

^ r(o). 



N — pr ^-^ 



Therefore, ^ jg / ^"(y'' y"') ^ ^i^) ^ ~ ^'^^ result holds. 



□ 
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Lemma 5. |A4_7v| = o(l) v — a.s. 

Proof. Taylor's expansion up to the second order entails 



iA4,^i < iiiriioo^ 



+ ^lirilcc^^r(o). 



From condition K4 we have 



rp ^ r-p ^ . ^-^ N^oa 



j = l j=iil,i2&Ij 

Furthermore, ^^f^ ^ ^ ^ as ^ oo, so that |A4,Ar| = o(l). 



□ 



Lemma 6. 

In the {X.,Y)-weak dependence setting, 



A2,Ar| r< 



9 ? ? ^ 

r^p rp r^p-" 
—;= + —= -\ A(r) V - a.s. 



Moreover in the case of {K,,Y)-weak dependence 



\A2,n\ ^ 

Proof. Let define, for j — 1 . . .r, 



2 2 

1^ 



K{r) V — a.s. 



A, = E^[/(>V,+M,)-/(W,+^i*)], 

where Mj = u* = ^U* , Wj = Uj + J^.^. u* and ujj = J2i<j ^i- 

Using the properties of the exponential function f{z) — exp~"^ and the independence properties 
of the variables {U*} we have 



A, 



(E^[/K)/K)] -IE^[/K)]IE^ [/(<)]) [/(E*>K)], 



cov{f{u,)J{u,)\Y)¥}' [f (e. 



Then, we have 



< 



(48) 



(49) 



From equation ((48|l and applying the definition of (A, y)-weak dependence, for Y fixed, it follows 
that 

|A,| < ||/||co|co.(/(^E™<,E.e/„.^0'^fe^^^^.^O) 

+ up{f)up{f)^ E™<, E.,e/„ ^(y'O;^ E..e/, ^(y^^)] Ka)- 

Furthermore, by the SLLN we have that condition K5 implies 

E E ^(y'') = ^^^p)^ and ^ y(/^) = o{p). 

Then, from equation (j49| . the results follows for (A, F)-weak dependence. In the case of (k, y)-weak 
dependence the proof is similar. 

□ 
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2 + 5 

Lemma 7. IA3 ^ ''^ , v — a.s. 

AT +2 

Proof. Let define, for j ~ 1 . . .r, 

a;. E''[fiW-+u*)-fiW-+u^)i 

where u* = ^U;, u'^ = ^A^,-, = ^ i < ju* + 

Using the properties of exponential function f(z) = exp~"^ and the independence properties 
of the variables {A/'j}, we have 

a;.=e^[/(u*)-/(^;.)]e^[/(w;)]. (so) 

Thus, 

r 

\A,M<T.\^\- (51) 

As ]E^[u*] = = and E'*'[|u*p] = E"^[|u*p], then taking Taylor's expansion up to order 

2 or 3 respectively yield: 



This implies that 



ia;.| < Uwf^'MiMu*? + K)^]) A U\\f(^)\\^E[iu*r + K) 



< :^ii/iioo \\nL^{E'-[\u,r']+E[\Af,r']). 

Since {Mj} is a sequence of gaussian r.v. 



E[|AGf+*] < 3^E^[|C/,f]^. 
On the other hand, applying Jensen's and Minkowski's inequalities, we get 

From condition K2s and applying the SLLN it comes 

E[\Uj\^+^]+E^[\Afjf+^] = 
So, from ISni) and ED the result holds. 



Let us assume that there exists a, (3 with < f3 < a < 1 such that for e N 

p{N) = A^", and ^(A^) A^^^. 
In the case of (A, Y')-weak dependence: from Lemmas HI O H] and [7] we obtain that 



A3 

A4,Ar = 0(1). 



(52) 



□ 
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Then, there exists 9 > such that |Ajv| < ^ if and only if 

S 3 

< P < a < — — and - - \f3 < a. (53) 

2(1 + o) 2 

We can to determine the values of a and (3 so that condition ((55|) holds, whenever A > 2 + |. 
Moreover for the case of (k, 2, F)-weak dependence we readily obtain that there exists 6 > such 
that IAatI < N-^ whenever k > 2 + |. 

This allows to prove that, for aU t fixed, {X^{Y)} converge in distribution to a mean zero 
Gaussian random variable with variance r(0). 

Now, let us consider X^{Y) = Yfk=i ^kX^^{Y) with {ti,...,U) e IJ^ and (ai, . . . , a^) e . 
We can write as 

where _Z' = j:LiC^kZl- 

Using a similar technique to the one applied in the proof of Theorem [21 we can verify easily that 

\i Z — {Z^} is a (e, y)-weakly dependent doubly stochastic processes then {Z^} is also (e, F)-weakly 

dependent. Moreover, condition K2s, K4 and K5 are satisfied for {Z^}. Furthermore, the variance 

a%{Y) of X^{Y) is such that 

d d 

^l{y) - E "fcr^(^fe - ' - ti)ai = a\ 

k,l=l k,l=l 

Then, in the same way as before we show that (Y) converge weakly, i/ — a.s., to a centered 
Gaussian random variable with variance a^. Therefore, we obtain that the process X^{Y) — 
{X^ (Y) : t £ Zi} converges in distribution, i/ — a.s., to a centered Gaussian process X = {Xt : t e 
Z} with covariance function T. 

7.5 Proof of Lemma [T] 

We prove, under weak dependence property and condition £2^, that there exist d > 1 such that 
\x{f)\ ^ 0{r~'^), so X is a weak interaction in 



Proof. Let T > 1, we define /t(z) = (z V -T) A T, z e M, lipifr) = 1 and H/tIU = T. By 
Lemma [21 for k G N, we have 

E[\el - /T(£Dh < 2E[|ej|2+'5]T-(2+'5-fe). 

Then if {ej} is A- weakly dependent, following the proof of Lemma [3l we have 

\X{^-J)\ < \cov{el-fT{sl),ei)\ 

+ \coviMsl),ei-fT{ei))\ 
+ \cov{Mel), Mem 

< 6E[|£^j2+*]T-'5 + (2T+l)A(i-j) 

< (6VE[|£?r^])(T-^ + rA(z-j)). 

Finally, taking T = X{i - j)^^ , we obtain that |x(i - j)\ ^ 0(A(i ~ j)^). 
Otherwise in the case of k- weakly dependent, we obtain 

\x{^-J)\<6E[\el\'+']T-' + >,{^-J). 

Then, by choosing T such that K{i - j) = 6E[\el\'^+^]T-^ , it follows \x{i - j)\ di 0{K{i - j)). 

□ 
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7.6 Proof of the SLLN for T^{Y): case of DSV* processes. 

The following proof goes to the same lines of the one given in ^Lj for SLLN in the case of linear 
processes. 

Proof. The proof of theorem will be presented in three parts. 

[■ fc 1 [■ k 1 

Part 1: Since x G -^ij then j^'^ < \\x\\i and ' j^'^ converge to Sk, for each fc, with \sk\ < \\x\\i- 
On the other hand, condition C2 implies X^feLi 4'k{T) < oo. Then, for all r G Z, we have 

oo r ^1 OO 

fc=l k=l 

Therefore, 

DO OO r fci 

Rn{t) :=E[r^(r,y)]=E7fc(r)+E'^'^-W^^Sv ^^^^^ 

fc=l k=l 

For any values of sequence {sfe}, i?Ar(r) has a non-zero limit. 

Part 2: Let Mr.k{y^) — [^'r.fc (y* , y-* )] , for i ^ j, where E'[-] is the conditional expectation with 
respect to y*. Then, {Mr,k{y^) ■ i € N} is an i.i.d. sequence with E[Mr,k{y^)] = 4'k{T)- 

Let HI be the Hilbert space generated by {^'r,fc(y*, y-') : ^ e N, 1 < i 7^ j < N}, Hi the linear 
space generated by {«'r,fe(y%y^) - M,,fc(y') - M^,fc(yJ) + (bkir) : fc e N, 1 < z < j < A^}, H2 the 
linear space generated by {Mr^kiy^) + Mr,k{y-') — 2(^fc(T) : fc € N, 1 < i < j < N} and C the space 
of constants, then Hi , IHI2, C form an orthogonal decomposition of H; i.e. H = Hi H2 ® C. This 
can be checked by realizing that E*[5'T-^fc(y% y^)] = ^ — a.s. for i ^ j. We define 

^ N 00 

^ 00 

Qn{t,y) = ^ E E(^-.'=(y') + ^^-.'=(y')-20fe(r))x'(*-j), 

^ 00 

[/jv(T,y) - ]^ E E(*-^''•(y^y')-M.,fc(y')-Af.,fc(y^") + 0fcM)x'(^-J)■ 

l<i^j<N fc=l 

H's orthogonal decomposition applied to (r, F ) — Tat (t, y ) gives the following orthogonal de- 
composition 

{t,Y) -Tn{t,Y) ^ Rn{t,Y) + Qn{t,Y) + Un{t,Y) . 

In what follows, we will show that T^qir^Y), Qn{t,Y) and Un{t,Y) converge to zero v — a.s 
and in L^{v) under some given conditions. If the limits v — a.s and in L^{v) of F^ exist, then they 
must be the same. 



Step 1: (T/v's convergence to zero) 
Under condition C2 we have 



k=l 



<E[||C(/)|1^] <CX3. 



Then,, for each r G Z, the SLLN implies that Tjv(t, F) converges in L^ii^) and ly — a.s. to zero. 
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Step 2: {Qn's convergence to zero). 
We can write 

Qn{t, n = ^ E E i^^r,k{y') ~ Mr)) {sN+l-^{k) + S,{k)) , 
i=l fc=l 

So that E[Qn{t, Y)] = and 

E[\Q^{r,Y)\^] = ^. 

where 

TV oo 

Ajv = 4^ E COv{Mr,k{f), Mr,l{r)){sN-i{k)+Si{k)){sN-i{l) + S,{l)) 
i=l k,l=l 

N ca 

< 4^ E ^r,kAr,l \sN-i{k) + Si{k)\ |sjV-i(0 + Si{l)\ , 
i=l k,l=l 

with Ar,k = E [|M^,fe(y*) - <^fe(T)|2] ^ Furthermore, 

|s^r-,(0+ 5.(01 < E lx'0-)l+Elx'(j')l^2||x'||i<2||x|li 

^f:\^N-.ik)+sm ^ fc. 

i=l 

Moreover, from condition C2 

oo CXD 

E^-.fe < E^[i*-.fe(y''y')-'^fc(^)i']' 

CO 

< EE[l*-.fc(y^y')l'^' 
fc=i 



1+T,...,h+T 

k=Oli<...<lk 

< E[||c(y)||^] <oo. 



Therefore, 



Aiv^8||x||i (^E^r,fej [lx|]iv,i and E[\Qm{t,Y)\^] ^ O 



N.l 



iV2 



(54) 



Thus, we obtain that E[(5//(t, y)]^ < oo. Since [|x|]jv,i = 0{N) then Qn{t,Y) converges to 
zero in L^{y). 

We have two cases: 

• Case 1: Ajv converges to a finite limit, Ajv = 0(1). 

• Case 2: Ajv converges to +oo. 
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In the case 1, we have K[\Qn{t, Y)\'^] — 0{N^'^), so from Borel-CantelU's lemma we derive the 
v — a.s. convergence to zero of Qn{t^ Y). 

In the case 2, to prove hm^v^oo Qn{t, Y) = v — a.s., we can apply Petrov's Theorem (|24j.6.17 
p 222): let Q*j^ = Tli^i C be a sum of independent centered random variables such that its variance 
Ajv diverge to infinity. Then Q*^ = o(-\/Ajv6(Ajv)) for all function 8 such that ^ nSiii) ^ 



In our case, — Q*j^/N, so it is sufficient to find 8 such that 



(n) 

AAre(Aw) = 0(7V2). 



We have from ^ that Ajv = ^([IxIIjv,!) and [|x|]Af,i) = 0{N). Then, taking e(n) = n we obtain 

A^8(A^) = A^, ^ 0{[\x\]l,^) = 0{N'). 
Consequently Qn{t, Y) converges v — a.s. to zero. 

Step 3: ([/jv's convergence to zero). 

We consider the kernel defined, for i j, by 

oo 
k=l 

where 

This kernel is symmetric and degenerated, i.e., [^^(y*, y-')] = /i — a.s. Whence we have that 
mAr,y')] - 0, E[$,(y%yJ>,(y™,y")] = for (i.j) ^ (m,n). 

In the same way as we bound A^^k hi the Step 2, we can verify that condition C2 implies 



Then writing 



we obtain 



fc=l 

C/^(r,r) = l '^r{y\yn, 



N 

l<i^j<N 



oo 

E[\u^{r,Y)f] = — ^ Y.^i^rMy\f)^rAy\y')]x{^-J)'x{^-Jy 

i<i^j<N fc,;=i 

^ ]^ E f2mrAy\yn\']^mrAy\y)\']^\x'i^-JWi^-J)\ 



i<iT^j<N k,l = l 



< 



f;E[|<i>.,,(y\y^-)p]^ (^[x"']n,i 
1=1 ^ 

2 [lx|]Af,l 



Hence J2n^1^n{t,Y)]'^ < oo. Since [|x|]Ar,i = 0{N) then Qn{t,Y) converges to zero in L'^{v). 

Let us now prove the v — a.s. convergence of Un- We prove the v — a.s. convergence oi Un to 
zero, following the scheme of the classical proof for the SLLN in the case of i.i.d., [21] ■ See [57] for 
the Central Limit Theorem. 



L. J. Fcnum 



30 



Let a > 0, 



P (ma^\Un{r,Y)\ >2a\ < fl ^{\Uk-{r,y)\ > «) 

fe=L^J 



Prom estimation of E[|J7jv(r, and applying Tchebychev's inequality, we have 

WITT (-r V\\ ^n\<- ^r[\x\y,2 (Tlrk2 

where r„ = YTj^i \x{j)\ < \\x\W < Then, 



OO CO 1 1 1 1 

fc=l fe=l 



< OO. 



So, the series X^^^^jIPdC^fes (t, y)|>a) converges. 
On the other hand, 

C/„(r,y)-f/fe2(r,y) = i ^ $^(yi,y^)+('l_ 



1 1 



l<i^J<fe2 



yl(n,/c2) 

where A(n, /e^) = {i, j : 1 < i < j, fc^ < j < n} U {i, j : 1 < j < i, fc^ < i < n}. So 



max |C/„(T,y) - f/fc2(r,y)| < ak + bk, 
<"<(fe+i) 



with 



max 

fe2<„<(fe + l)2 



max 

fe2<n<(fe+l)2 



A(n,fe2) 
1 1 

n fc2 



E "^riry) 

l<i<j<fe2 



Since au < 



A(fe2,(fc + 1)2) 



|$,(y%y^)|, then 



P(afc > a) < 



< 



E 



E l*x(y^y')l 

^^A(fe2,(/j+l)2) 

E \x{i-j)\ 

. A(fe2,(/C+1)2) 
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Since x is a stationary interaction it holds 

< 2(fc + l)r(fe+i)2. 

So that 

PK>a) < ,.^4^^^ 



< 



In the same way, 6^ < -p- 



so 



m>a)< — — 

Since P(maxfe2<„<(fc+i)2 |[/„(T,r) - C/fe2(r,r)| > a) < P(afe > a) + V{bk > a) then 
£ ipf,,^max |C/„(r,y)-t/fe2(r,y)| >a) < oo . 

^ — ' \/c^<n<(/c+l)^ / 

k= [^/N^ 

FinaUy, from Borel-CanteUi's lemma we derive the v — a.s. convergence to zero of Un{t, Y). This 
proves the convergence v — a.s. 

Part 3: (F^'s convergence). 

We have proved, in Part 2, that Tjv, Qn and Un converge v — a.s. and in Li{v) to zero. Then, 
following Part 3 in the proof of Theorem 1 in [I] , we obtain from orthogonal decomposition 

F^(t, Y) - Rn{t) = Tn{t, Y) + Qn{t, Y) + Un{t, F), 

that T^{t, Y) converge in L^(i^) and ly — a.s. to F(r). 

□ 
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